Learning to score and summarize figure skating sport videos

This paper focuses on fully understanding the figure skating sport videos. In particular, we present a large-scale figure skating sport video dataset, which include 500 figure skating videos. On average, the length of each video is 2 minute and 50 seconds. Each video is annotated by three scores from nine different referees, i.e., Total Element Score(TES), Total Program Component Score (PCS), and Total Deductions(DED). The players of this dataset come frommore than 20 different countries. We compare different features and models to predict the scores of each video. We also derive a video summarization dataset of 476 videos with the ground-truth video summary produced from the great shot. A reinforcement learning based video summarization algorithm is proposed here; and the experiments show better performance than the other baseline video summarization algorithms.